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A Method of Decoding Variable Length Prefix Codes 

A portion of the disclosure of this patent document contains material that is subject 
to copyright protection. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent document or the patent disclosure, as it appears in the 
Patent and Trademark Office patent file or records, but othen^se reserves all copyright 
rights whatsoever. 

BACKGROUND 

1. FIELD 

The present kivention relates generally to decoding of variable-length prefix 
codes, e.g., Huffinan codes, and, more specifically, to a new, combined decoding scheme 
of lookup table decoding and prefix oriented decoding. 

2. DESCRIPTION 

Entropy coding is a widely used data compression technique that many video and 
audio coding standards are based on. The theoretical basis of entropy coding states that a 
compression eflfect can be reached when the most firequently used data are coded with a 
fewer number of bits than the number of bits denoting the less frequently appearing data. 
This approach results in coded data streams composed of codes having different lengths. 

There are a number of methods to form such variable length codes (VLC). One 
popular method uses a prefixed coding in which a code consists of a prefix that allows a 
decoding system to distinguish between different codes, and several significant bits 
representing a particular value (e.g., Hufi&nan coding). 

While most coding standards employ Huffman codes with prefixes composed of a 
series of 'T or '0' bits in their coding schemes, some standards (e.g., ISO/IEC 14496-2, 
Moving Pictures Experts Group (MPEG)-4 coding standard, Visual) allow for different 
coding schemes prefixed with a series of longer bit patterns. 

As a general rule, the number of bits that comprise a variable length code depends 
on the number of bits that comprise the prefix of the code. At the same time, an 
e^qperimentally defined subset of most firequently appearing codes may have relatively 
short prefixes (including zero prefix) and, thus, may be decoded in a lookup manner as a 
single code, which may be a faster way of decoding for a particular system. 
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Therefore, a need exists for the capability to provide high speed decoding of 
variable length codes prefixed with regular combinations of bits, in accordance with the 
actual frequency-to-code length distribution. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features and advantages of the present invention will become apparent from the 
following detmled description of the present invention in which: 

Figure 1 is a diagram illustrating an exemplary variable length coding; 

Figure 2 is a diagram illustrating relations between bits initially read from a bit 
stream, selected bits, and a table containing a decoded value, a validity indicator and 
auxiliary informatioi^ and 

Figure 3 is a flow diagram illustrating the variable length decoding process in 
accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION 

An embodiment of the present invention is a method of implementing a decoder for 
variable length codes that have prefixes composed of regular bit patterns. To apply the 
disclosed method to a particular coding scheme, such a scheme should comprise a subset 
of most frequentiy used codes with relatively short prefixes (including zero prefix), such 
that the prefix scan operation becomes inefficient. According to the disclosed method, the 
number of bits, not less than the maximal possible length of a VLC, is read from a bit 
stream. Then a predetermined number of bits is selected and used as an index to a data 
structure that contains at least a decoded value and validity indicator, along with other pre- 
decoded data, including but not limited to: prefix type and length, maximal code length for 
a group of codes, actual code length, and the number of bits to return to the bit stream. The 
validity indicator is used to determine whether to proceed with the decoding operation, or 
obtain the valid decoded value from the data structure and return excess bits to the bit 
stream. If the decoded value is indicated to be invalid, the decoding operation is continued, 
and a decoding method that estimates the length of the code prefix and the number of 
significant bits corresponding to the length estimated is applied to the bits initially read 
from the bit stream. The disclosed method requires less memory than direct lookup 
decoding methods, and performance of the method exhibits less memory access overhead 
as compared to prior art methods using multiple lookup tables. Additionally, the present 
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method appears to be more efficient for decoding of 'short prefix* codes as compared to 
other prefix oriented methods because it excludes operations of prefix type and length 
determination for the most fi^equently used codes. 

Reference in the specification to "one embodiment" or "an embodiment" of the 
5 present invention means that a particular feature, structure or characteristic described in 
connection with the embodiment is included in at least one embodiment of the present 
mvention. Thus, the appearances of the phrase "in one embodiment" appearmg in various 
places throughout the specification are not necessarily all referring to the same 
embodiment. 

10 Figure 1 is a diagram illustrating an exemplary variable length coding. As depicted 

by Figure 1, each variable length code has a group of bits used as a prefix 10 and a group 
of significant bits 12. The prefixes may be composed of a group of bits (bit patterns) that 
(in a general case) are replicated and concatenated to each other. The bits that follow the 
code prefix may be called significant bits. 

15 Variable length codes (VLCs) may have identical prefixes. In this case, the codes 

constitute a prefix code group, but at the same time the number of significant bits that 
follow the prefix may differ. The maximal number of significant bits that is possible for a 
code in such a group may be referred to as the maximal bit number. The number of bits 
that follow the prefix for each VLC may be called the actual bit number. 

20 Figure 2 is a diagram illustrating relations between bits mitially read firom a bit 

stream, selected bits, and a table containing a decoded value, a validity indicator and 
auxiliary information in accordance with an embodiment of the present invention. As 
depicted in the example of Figure 2, the ntimber of bits 20 not less than any possible VLC 
length, i.e., the number of bits enough to contain the longest VLC in a particular coding 

25 scheme, may be read firom a bit stream. Any number of leading bits 22 may be selected 
fi-om the bits read. A data structure 24 is provided to contain at least decoded data and a 
validity indicator for each bit combination that may be formed firom the selected bits. The 
data structure 24 may also contain auxiliary information on the type of prefix, code length, 
and the ntimber of bits to return to the bit stream, in order to facilitate fijture decoding. 

30 Figure 3 is a flow diagram illustrating a variable length decoding process in 

accordance with an embodiment of the present invention. At block 100, the number of bits 
not less than any possible variable length code is read firom a bit stream. The number of 
bits read should be suflBlcient to contain the longest variable length code but is not linsited 
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to store extra bits as it may facilitate the decoding process (e.g., the bits read fit the machine 
word size). Then, at block 102, the predetermined number of bits may be selected from the 
bits previously read. The number of bits to select depends on a particular coding scheme 
used, and, therefore, is determined by external means. The determination should be 
performed in a manner that allows the selected bits to span the most frequently used (the 
most probable) VLCs and at the same time tq,''minimize the size of a code lookup table. At 
block 104 the code lookup table is indexed with the value formed from the selected bits, and 
at least a decoded value and a validity indicator, as well as auxiliary information are 
obtained. In one embodiment, obtaining the auxiliary information may be optional. The 
validity indicator is then checked at block 106, and if it is indicated to be valid, the decoded 
value obtained at block 104 is returned as the result of the decoding process at block 108. If 
necessary, the actual code length or the difference between the actual length and the number 
of selected bits (retrieved as auxiliary information at block 104) may be checked in order to 
adjust the bit stream after decoding. 

If the decoded data is indicated to be invalid, a prefix oriented decoding method (i.e., 
a method that estimates the length of the code prefix and the number of significant bits 
corresponding to the length estimated) is applied at block 110 to the bits initially read from 
the bit stream. The auxiliary information obtained at block 104 may describe the type and 
length of the code prefix, and thus, increase the performance of the method to be further 
applied. 

For an exemplary embodiment of the present invention implemented in the C and 
Assembler programming languages, refer to Appendix A. This example is non-limiting and 
one skilled in the art may implement the present invention in other programming languages 
without departing from the scope of the claimed invention. 

The techniques described herein are not limited to any particular hardware or 
software configuration; they may find applicability in any computing or processing 
environment. The techniques may be implemented in logic embodied in hardware, software, 
or firmware components, or a combination of the above. The techniques may be 
implemented in programs executing on programmable machines such as mobile or 
stationary computers, personal digital assistants, set top boxes, cellular telephones and 
pagers, and other electronic devices, that each include a processor, a storage medium 
readable by the processor (including volatile and non-volatile memory and/or storage 
elements), at least one input device, and one or more output devices. Program code is 
applied to the data entered using the input device to perform the functions described and to 
SAMEHJnOII^na JIHCT (UPABHJIO 26) 
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generate output information. The output information may be applied to one or more output 
devices. One of ordinary skill in the art may appreciate that the invention can be practiced 
with various computer system configurations, including multiprocessor systems, 
minicomputers, mainframe computers, and the like. The invention can also be practiced in 

S distributed computing environments where tasks may be performed by remote processing 
devices that are linked through a communications network. 

Each program may be implemented in a high level procedural or object oriented 
programming language to communicate with a processing system. However, programs 
may be implemented in assembly or machine language, if desired. In any case, the 

10 language may be compiled or interpreted. 

Program instructions may be used to cause a general-purpose or special-purpose 
processing system that is programmed with the instructions to perform the operations 
described herein. Alternatively, the operations may be performed by specific hardware 
components that contain hardwired logic for performing the operations, or by any 

IS combination of programmed computer components and custom hardware components. 
The methods described herein may be provided as a computer program product that may 
include a machine readable medium having stored thereon instructions that miay be used to 
program a processing system or other electronic device to perform the methods. The term 
''machine readable mediiun" used herein shall include any medium that is capable of 

20 storing or encoding a sequence of instructions for execution by the machine and that cause 
the machine to perform any one of the methods described herein. The term ''noiachine 
readable medium" shall accordingly include, but not be limited to, solid-state memories, 
optical and magnetic disks, and a carrier wave that encodes a data signal. Furthermore, it 
is common in the art to speak of software, in one form or another (e.g., program, 

25 procedure, process, application, module, logic, and so on) as taking an action or causing a 
result. Such expressions are merely a shorthand way of stating the execution of the 
software by a processing system cause the processor to perform an action or produce a 
result. 

While this invention has been described with reference to illustrative embodiments, 
30 this description is not intended to be construed in a limiting sense. Various modifications 
of the illustrative embodiments, as well as other embodiments of the invention, which are 
apparent to persons skilled in the art to which the invention pertains are deemed to lie 
within the spirit and scope of the invention. 
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APPENDIX A 



© 2002 Intel Corporation 
GetVLC function (Assembler) 
InitTable function ("C^ 

Input table CC) and initial HufiQnan table (text) 
Bit strcsam structure ("C") 

Initial Huffinan code table 



Codes Vector differences 

1 0 



010 


1 


oil 


-1 


0010 


2 


0011 


-2 


00010 


3 


00011 


-3 


0000110 


4 


0000111 


-4 


00001010 


5 


0000101 I 


-5 


00001000 


6 


00001001 


-6 


00000110 


7 


00000111 


-7 


0000010110 


8 


0000010111 


-8 


0000010100 


9 


0000010101 


-9 


0000010010 


10 
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OOOOOIOOll 


-10 


00000100010 


11 


00000100011 


-1 


00000100000 


12 


00000100001 


-12 


00000011110 


13 


00000011111 


-13 


00000011100 


14 


00000011101 


-14 


00000011010 


15 


00000011011 


-15 


00000011000 


16 


00000011001 


-16 


00000010110 


17 


00000010111 


-17 


00000010100 


18 


00000010101 


-18 


00000010010 


19 


00000010011 


-19 


00000010000 


20 


00000010001 


-20 



25 Packed code/value table containing 

information on prefix length and 
significant bit number 

/// the table elements should be sorted by prefix length 

30 

static const long exTable_Mixed[] = 

{ 

13, /* max bits | bit-size flag */ 
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7, /* number of prefix groups *l 

S, /* lookup table length (in bits) */ 

1, /* code length */ 
5 1, /♦ size of group */ 

0, /* bit index*/ 
0, /* get bits */ 
0, /* unget bits ♦/ 
0x00010000, 
10 3, /* 3-bit codes */ 

2, 
1. 
1, 
0, 

15 0x00020001, 0x0003flBff, 

4, /* 4-bit codes */ 
2, 

2, 
1, 

20 0, 

0x00020002, 0x0003flEFe, 

5, /* 5-bit codes */ 
2, 

3, 

25 1. 

0, 

0x00020003, Ox0003ffia, 

8, /* 8-bit codes */ 
4, 

30 4, 
3, 
0, 

0x00080006, 0x0009fBfe, 0x000a0005, OxOOObflBB), 
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7, /♦7-bit codes*/ 
2, 

4, 
3, 

5 1, 

0x00060004, OxOOOTfffc, 
11,/* 11-bit codes*/ 
4. 
5, 

10 5, 
0. 

0x0020000c, 0x0021flBf4, 0x0022000b, Ox0023flEE5, 
10, /* 10-bit codes */ 
6, 

15 5, 
5, 
1, 

0x0012000a, 0x0013fiBf6, 0x00140009, Ox0015flSf7, 0x00160008, 0x0017flBE8, 

8, /* 8-bit codes */ 
20 2, 

5, 
5, 
3, 

0x00060007, Ox0007fH9, 
25 11,/* 11-bit codes*/ 

16, 
6, 
4, 
0, 

30 0x00100014, 0x001 IfFec, 0x00120013, 0x0013flFed, 0x00140012, OxOOlSffee, 

0x00160011, 0x0017flfef, 0x00180010, 0x0019fiBR), OxOOlaOOOf, OxOOlbfffl, 
OxOOlcOOOe, OxOOldfiBE, OxOOleOOOd, OxOOlfBBB, 
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-1 /* end of table */ 

}; 

Bit Stream stnictures 

typedef struct _MplDataBuf 
{ 

unsigned char *data; 
long datajen; 
long data_ofifset; 
} MpIDataBuf; 

^edef struct _Mp]BitStream 
{ 

long bit_ptr, // Buffer bit pointer (3 1 -0) 

MpIDataBuf *data_buf; // Pointer to data and its size 

unsigned long *start_data; // Internal bitsream pointers 
unsigned long *^d_data; 
unsigned long *current_data; 

FILE *fd; // Input or output file 

jmp_buf exit_point; // Exit point to handle incorrect vie codes 
} MplBitStream; 



#define DATA_BUFFER_SIZE 1 * 1024* 1024 

unsigned long bit_mask[33] = 
{ 
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0x00000000, 

0x00000001, 0x00000003, 0x00000007, OxOOOOOOOf, 
OxOOOOOOlf, Ox0000003f, 0x0000007f, OxOOOOOOflf, 
0x000001 fF, OxO00OO3fF, OxOOOOOTfiF, OxOOOOOflff, 
OxOOOOlflff, Ox00003flEF, 0x00007flfiF, OxOOOOfiff, 
0x000 IflBBF, Ox0003ffBf, 0x0007fHf, OxOOOfiBBBF, 
OxOOlffHf, OxOOSflBBBf, 0x007flfflBf, OxOOflffffiF, 
OxOlflfflBBF, 0x03fiBEffi; 0x07fiBaff, OxOfffiSfF, 
OxlflBBEEff, Ox3flBBBBff, 0x7ffiBBBBF, OxfBfBGBff 

}; 



Function to form internal VLC table 



typedef unsigned long VLCDecodeTable; 

static VLCDecodeTable* CreateVLCDecodeTable_Mixed(const long *src_table, 
VLCDecodeTable *table, long *table_size, long cyr_size) 
{ 

int vm4_vlc_code_mask, vm4_vlc_data_mask, vm4_vlc_shift; 

int of&et; 

inti,j; 

int codejength; 
int group_size; 
int bit_index; 
int get_bits; 
int unget_bits; 
int group_count; 
int outidx; 
int group_ofiFset; 
int lookup_length; 
int prefix_offset; 
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switch(*srcjable++ & VM4_VLCJLEN_FLAG) 
{ 

case VM4_VLC_20: 

vm4_vlc_code_mask = OxfififfDOO; 

vm4_vlc_data_mask = OxOOOOOfiF; 

vm4_vlc_shift =12; 

break; 
case VM4_VLC_24: 

vm4_vlc_code_mask = OxflBBBffDO; 

vm4_vlc_data_mask = OxOOOOOOfF; 

vm4_vlc_shift = 8; 

break; 
default: 

vm4_ylc_code_mask = OxflBEfDOOO; 
vm4_vlc_data_mask = OxOOOOflBBf; 
vin4_vlc_shift =16; 
break; 

} 

offset = *src_table++ * 2; 
lookup_length= *src_table++; 
prefix_ofl&et = (1 « lookupjength) * 2 + 2; 
offset += prefix_offset; 

memset(table, 0, oflfeet * sizeof(VLCDecodeTable)); 
///memset(table, -1, prefix_oflfeet * sizeof(VLCDecodeTable)); 

table[0] = 32 - lookupjength; /// the bit count to shift light 
table[l] = prefix_offset; 

while(*src_table != -1) 
{ 

code_length= *src_table++; 



wo 2005/006562 



13 



PCT/RIJ2003/000307 

I 



group_size = ♦src_table++; 

bit^index = ♦src_table++ ♦ 2 + prefix_oflfset; 

get_bits = *src_table-H-; 

uaget_bits = *src_table++; 

if(ltable[bitjndex]) 
{ 

table[bitjnd«] = get_bits; 

table[bit Judex + 1] = group_ofFset = offset; 

} 

for(i = 0, group_count == 0; i < group_size; i++) 

{ 

if(code Jength < lookup Jiength) 

{ 

forO = 0; j < (1 « (lookupjength - codejength)); j++) 
{ 

outidx = ((((((unsigned long int)(*src_table & vm4_vlc_code_mask)) 
» vm4_vlc__shift) & bit_mask[code_length]) 
« (lookupjength - codejength)) +j) * 2; 

table[outidx + 2] = /*lookup Jength - */code Jength; 
table[outidx + 2 + 1] == ((*srcjable & Ym4_vlc_data_niask) « (32 - 
vm4_vlc_shift)) » (32 - vin4_vlc_shift); 

} 

} 

else if(codeJength = lookupjength) 

{ 

outidx = ((((unsigned long int)(*srcjable & vm4_vlc_code_mask)) 
» vm4_vlc_shift) & bit_niask[code Jength]) * 2; 

table[outidx + 2] = codejength;///0; 

table[outidx + 2 + 1] = ((*src Jable & vm4_vlc_datajtnask) « (32 - 
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vm4_vlc_8hift)) » (32 - Yin4_^ic_shift); 



} 



i£(lunget_bits) 
5 { 

outidx = ((((unsigned long int)(*src_table & vm4_vlc_codejDaask)) 
» vm4_vlc_8hift) & bit_mask[get_bits]) * 2; 

table[group_oflFset + outidx] - ((*src_table & vm4_vlc_data_mask) « 
10 (32 - Ym4_vlc_shift)) » (32 - 

vm4_vlc_shift); 
table[group_oSset + outidx + 1] = 0; 
group_count++; 
src_table++; 

15 } 

else 

{ 

for(j = 0; j < (1 « unget_bits); j++) 
{ 

20 outidx = ((((((unsigned long int)(*src_table & vm4_ylc_code_Daiask)) 

» Ym4_vlc_shift) & bit jtnask[getjbits - unget Jbits]) 
«ungetj5its)+j)*2; 

table[group_ofFset + outidx] = (('^'src^table & vni4_vlc_data_mask) 
25 « (32 - vm4_vlc_shift)) » (32 - 

vm4_vlc_slTift); 
table[group_ofFset + outidx + 1] = unget_bits; 
group_count-H-; 

} 

30 src_table++; 
} 

) 

offset += group_coxint * 2; 
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♦table_8ize = offset; 

5 return (VLCDecodeTable*)table; 

} 



10 



15 



Function to decode VLC (Assembler) 

.686 
.xmm 

xmmword textequ <qword> 
mmword textequ <qword> 
.model FLAT 



20 



MplDataBuf struc 4t 

data dd ? 

datajen dd ? 

data_ofifset dd ? 

MplDataBuf ends 



25 



MplBitStream struc 4t 
bitjptr dd ? 



;;; Buffer bit pointw (3 1-0) 



data buf 



dd 



;;; Pointer to data and its size 



30 



start_data dd ? 
end_data dd ? 
current data dd ? 



Internal bitsream pointers 



fd 



dd 



;;; loput or output j51e 
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exitjpoint dd ? 
MplBitStream ends 



;;; Exit point to handle incorrect vie codes 



_TEXT segment 



extm Jongjmp:near 



10 



: unsigned long asmbsGetVLCJLookupBitSearch 

(MplBitStream ♦bsm, const VLCDecodeTable *vlcTable) 



15 



_asmbsGetVLCJLookupBitSearch proc near 
sizeofjocals equ 14h 
ws equ esp + 04h 

bsm equ dword ptr [eax + 04h] 
table equ dword ptr [eax + 08h] 



20 



25 



30 



mov eax,esp 

sub esp,sizeof_locals 

and esp,OfffiffiSDh 

push eax 

mov [ws],esi 

mov [ws + 04h],edi 

mov [ws + 08h],ecx 

mov [ws + Och] , ebx 

mov [ws + 10h],ebp 

mov esi,bsm 

mov edi,table 

mov ecx,lfh 

sub ecx,MplBitStream.bit_ptr[esi] 

mov ebx,MpIBitStream.current_data[esi] 
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mov eax,[ebx] 
mov edx,[ebx + 4] 
shld eax»edx,cl 



eax = data 



10 



15 



test eax,eax 
jz error_code 



this branch is supposed not to be taken 



;;; look up several bits first 

mov ecx,[edi] 

mov edx,eax 

shr edx,cl 

mov ebp,[edi 4- edx * 8 + 8] 

or ebp,ebp 

jz scan 

mov eax,[edi + edx * 8 + Och] 

mov ebx,MplBitStream.bit_ptr[esi] 

sub ebx,ebp 

js negativejptr 



;;; ecx = 32 - lookup J>its 

;;; ebp = (un)get bits 

;;; not taken 
;;; eax == decoded data 

, not taken 



20 



25 



;;; exit 

mov MplBitStream,bit_ptr[esi],ebx 

mov esi,[ws] 

mov edi,[ws + 04h] 

mov ec?L, [ws + 081i] 

mov ebx, [ws + Och] 

mov ebp,[ws + lOh] 

mov esp,[esp] 

ret 



30 



scan: 



bsr ecx^eax 



ecx = index 



mov ebx,[edi + 4] 



ebx == prefix_oflfset 
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add ebx,62 

mov ebp,31 

sub ebx,ecx 

sub ebx,ecx ;;;ebx = offset (ofbit index group) 

5 sub ebp,ecx ;;; ebp = (31- index) 

mov edx,[edi + ebx ♦ 4] ;;; edx = get_bits 

mov ebx,[edi + ebx ♦ 4 + 4];;; ebx = offset (of code value and unget bits) 

sub ecx,edx 

10 shr eaXyCl 

and eax,bit_mask[edx 4] ;;; eax = data 

lea ebx,[ebx * 4] 

lea ebx,[ebx + eax ♦ 8] 

15 mov ecx,[edi + ebx + 4] ;;; ecx = unget_bits 

mov eax,[edi + ebx] ;;; eax = data 

mov ebx,MplBitStream.bit_j)tr[esi] 

lea edx,[edx + ebp + 1] 

20 add ebx^ecx 

sub ebx^edx 

js negativejptr ;;; not taken 

25 almost_exit: 

mov MplBitStream.bit_ptr[esi],ebx 

exit: 

mov esi,[ws] 

3 0 mov edi, [ws + 04h] 

mov ecx,[ws + OSh] 

mov ebx,[ws + Och] 

mov ebp,[ws + lOh] 
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mov esp,[esp] 
ret 



negative_ptr: 

5 add ebx,20h 

add MplBitStream, current_data[esi],04h 

jmp almost_exit ;;; taken 

error_code: 

10 push -1 

lea edx^MplBitStream. exit_point[esi] 

push edx 

call Jlongmp 

;;; no return here 

15 int OOh 

_asmbsGetVLCJLookupBitSearch endp 

_TEXT ends 

20 

_DATA segment 





bit_mask 


dd 


00000000b 






dd 


0000000 Ih, 00000003h, OOOOOOOTh, OOOOOOOfli 


25 




dd 


OOOOOOlfh, OOOOOOSfli, 0000007fh, OOOOOOffli 






dd 


00000 Iffh, OOOOOSffh, OOOOOTfEh, OOOOOfffh 






dd 


OOOOlfEEh, 00003fieQi, OOOOVfiBEh, OOOOfiEBQi 






dd 


OOOlfiBSh, OOOSflBBEh, 0007£BBEh, OOOfffiTh 






dd 


OOlflBBEfh, GOSflBBaai, 007fHHh, OOflffiHai 


30 




dd 


Olflfflfh, OSflBBBEEh, OVfiEBBEfh, Offflffiffh 






dd 


IflBEBBOai, SfflGBBBh, Tffffiffh, OflBEBBBBEh 




DATA 


ends 





end 



